Web Survey Bibliography
Many companies are faced with the question whether administering surveys to their employees via Internet technologies will lead to different results than surveying them with paper and pencil, just because of the technologies or the psychological aspects of using the technologies. In a 2x2x2x2 factorial (quasi-)experimental design it was investigated whether anonymity, voluntariness, age, and administration mode (Internet versus paper-and-pencil) would influence answering behavior in a newly designed short-format employee survey. Employees in one complete section of a large Swiss company (N=655) were randomly assigned to conditions and invited to participate in the survey. Overall, 318 employees responded, with lower return rates for anonymous and for voluntary conditions: anonymous & voluntary 31% return vs. less anonymous & less voluntary 58% return, with other conditions in-between. There was also a tendency for differences in dropout. Voluntariness had a significant effect on response times, a dependent measure that could be applied in the Internet condition only. Age and anonymity were shown to have significant influence on the expression of job satisfaction; voluntariness and administration mode showed tendencies to moderate these influences. Effects of anonymity were shown to be stronger for participants who chose to reveal even less information about themselves by leaving questions with identifying content unanswered. Results will be discussed in terms of the strategic aspect of the Social Identity model of Deindividuation Effects (SIDE). Methods and applications used in developing and administering the employee survey and in analyzing the data will be presented. Recommendations will be made regarding the increase of response rates, the avoidance of social desirability in survey answering behavior, and the organization of Internet-based employee surveys.
Das Internet kann für Mitarbeiterbefragungen eingesetzt werden, aber in vielen Unternehmen stellt sich die Frage, ob sein Einsatz einfach aufgrund dieser neuen Technologie oder der psychologischen Aspekte im Umgang mit der Technologie zu anderen Ergebnissen führen kann. In einem 2x2x2x2 faktoriellen (quasi-)experimentellen Design wurde untersucht, ob Anonymität, Freiwilligkeit, Alter, und Befragungsmodus (Internet-gestützt versus Papier-und-Bleistift) das Antwortverhalten in einer neu entwickelten kurzformatigen Mitarbeiterbefragung beeinflussen würde. Alle Mitarbeiter einer Arbeitseinheit (N=655) eines grossen Schweizer Unternehmens wurden zufällig den Versuchsbedingungen zugeteilt und zur Teilnahme an der Befragung eingeladen. Im Ganzen antworteten 318 Beschäftigte, es zeigten sich geringere Response-Raten in den anonymen und freiwilligen Bedingungen: anonym & freiwillig 31% Response vs. wenig anonym & eingeschränkt freiwillig 58% Response, die anderen Versuchsbedingungen lagen dazwischen. Es zeigte sich auch eine Tendenz zu unterschiedlichem Teilnahmeabbruch. Freiwilligkeit hatte einen signifikanten Effekt auf die Antwortzeiten, einem abhängigen Mass, das nur in der Internet-Bedingung erhoben werden konnte. Die Befragungsergebnisse zeigen Effekte von Anonymität und Alter auf Arbeitszufriedenheitsäusserungen, die tendenziell durch Freiwilligkeit und Befragungsmodus moderiert wurden. Einflüsse der Anonymität erwiesen sich stärker bei Teilnehmern, die noch weniger Informationen über sich preisgaben, idem sie Fragen mit identifizierendem Inhalt unbeantwortet liessen. Diese Ergebnisse werden im Hinblick auf das Social Identity model of Deindividuation Effects (SIDE) diskutiert. Methoden und Anwendungen, die in der Entwicklung und Durchführung der Mitarbeiterbefragung und bei der Datenanalyse benutzt wurden, werden vorgestellt. Es werden Empfehlungen zur Erhöhung der Response-Raten, der Vermeidung von sozial erwünschtem Antwortverhalten und zur Durchführung von Internet-basierten Mitarbeiterbefragungen gemacht.
Homepage - conference (abstract)
Web survey bibliography (4086)
- Do print and Web surveys provide the same results?; 2004; Huang, H.-M.
- Will Web Surveys Ever Become Part of Mainstream Research?; 2004; Schonlau, M.
- Online or Not Online? A Comparison of Offline and Online Surveys Conducted in the Context of 2002 German...; 2004; Faas, T.
- Recruitment for online access panels; 2004; Goeritz, A.
- Does Voice Matter? An Interactive Voice Response (IVR) Experiment; 2004; Couper, M. P., Singer, E., Tourangeau, R.
- No calibration required. Expanding the use of on-line research for new initiatives; 2004; Rogers, G., Dierckx, J.-H.
- A Comparison of Objective Characteristics and User Perception of Web Sites; 2004; Lee, S.-J., Lee, W.-N., Kim, H., Stout, P. A.
- The Effect of Billboards within the Gaming Environment; 2004; Chaney, I. M., Lin, K.-H., Chaney, J.
- Pros and cons of paper and electronic surveys; 2004; Porter, S. R.
- The Influence of Incremental Increases in Token Cash Incentives on Mail Survey Response; 2004; Trussell, N., Lavrakas, P. J.
- The impact of material incentives on response quantity, response quality, sample composition, survey...; 2004; Goeritz, A.
- Spacing, Position, and Order: Interpretive Heuristics for Visual Features of Survey Questions; 2004; Tourangeau, R., Conrad, F. G., Couper, M. P.
- The Influence of Graphical and Symbolic Language Manipulations on Responses to Self-Administered Questions...; 2004; Christian, L. M., Dillman, D. A.
- Scientific LogAnalyzer: A Web-based tool for analyses of server log files in psychological research; 2004; Reips, U.-D., Stieger, S.
- Identifying and Reducing Response Burdens in Internet Business Surveys; 2004; Haraldsen, G.
- The Ethics of Conducting E-Mail Surveys; 2004; Krishnamurthy, S.
- Readings in Virtual Research Ethics: Issues and Controversies; 2004; Buchanan, E. A.
- Validity of Data and Representativeness of Sample in Internet Survey; 2004; Katz, B., Matsuo, Hi., McIntyre, K., Tomazic, T., Bosch, R.
- Digital Audio File Recording in CATI Instruments; 2004; White, E., Kraft, J., Taylor, W.
- Online Surveys-Does One Size Fit All; 2004; Coates, D.
- E-Mail Contacts: A Test of Complex Graphical Designs in Survey Research; 2004; Whitcomb, M. E., Porter, S. R.
- Impacts of the Use of E-Mail and the Internet on Personal Trip-Making Behavior; 2004; Tonn, B. E., Hemrick, A.
- How You Ask Counts: A Test of Internet-Related Components of Response Rates to a Web-Based Survey; 2004; Trouteaud, A. R.
- Changing from PAPI to CAPI: A Longitudinal Study Dealing with Mode-Effects in the German Socio-Economic...; 2004; Schraepler, J.-P., Schupp, J., Wagner, G. G
- Collecting Data on Ego-Centered Social Networks on the Web: Methodological Issues; 2004; Lozar Manfreda, K., Vehovar, V., Hlebec, V.
- Effects of Mode of Interview, and moderating variables on Erectile and Ejaculatory Function Measures; 2004; Catania, J. A., Rosen, R. J., Wood Johnson, R., Jacobs, S., Sallis, J., Shpilsky, A.
- On the Variability of Estimates Based on Propensity-score-weighted Data from Web Panels; 2004; Forsman, G., Danielsson, S., Isaksson, A.
- The Online Survey: Its Contributions and Potential Problems; 2004; McIntyre, K., Tomazic, T., Katz, B., Matsuo, Hi.
- Raising response rates: What works?; 2004; Porter, S. R.
- The Internet: Marketing Researcher's Panacea or Pandora's Box?; 2004; Gurney, P. M., Chambers, E., Grant, L., Shah, S., Sullivan, M. P.
- Reading in Virutal Research Ethics; 2004; Anonymous
- Picture This! Exploring Visual Effects in Web Surveys; 2004; Couper, M. P., Tourangeau, R., Kenyon, K.
- Developing automated e-survey and control tools: an application in industrial management; 2004; Scornavacca Jr., E., Becker, J. L., Barnes, S.
- Gathering faculty teaching evaluations by in-class and online surveys: their effects on response rates...; 2004; Dommeyer, C. J., Baum, P., Hanna, R. W., Chapman, K. S.
- Survey Mode Preferences of Business Respondents; 2004; Tarnai, J., Paxon, M. C.
- Using progress indicators in web surveys; 2004; Heerwegh, D.
- Web Survey Design: Paging vs. Scrolling; 2004; Peytchev, A., Crawford, S. D., McCabe, S. E., Conrad, F. G., Couper, M. P.
- Web surveys: Best practices; 2004; Umbach, P. D.
- Telephone presurveys, self-selection, and non-response bias to mail and Internet surveys in economic...; 2004; Hudson, D., Seah, L. H., Hite, D., Haab, T.
- Doing Survey Research On The Internet: Yes, Timing Does Matter; 2004; Faught, K. S., Whitten, D., Green Jr., K. W.
- Methods for Testing and Evaluating Survey Questions; 2004; Presser, S., Couper, M. P., Lessler, J. T., Martin, E., Martin, J., Rothgeb, J. M., Singer, E.
- Cutting Market Research Costs with On-Site Surveys; 2004; Dysart, J.
- Psychological Testing on the Internet: New Problems, Old Issues; 2004; Naglieri, J. A., Drasgow, F., Schmit, M., Handler, L., Prifitera, A., Margolis, A., Velasquez, R.
- Web Surveys For the Enterprise; 2004; King, N.
- Using the Online Medium for Discursive Research About People With Disabilities; 2004; Bowker, N., Tuffin, K.
- Classifying and Coding Online Actions.; 2004; Hargittai, E.
- Paper and pencil or online? Methodological Experiences from an employee survey; 2004; Poetschke, M.
- Employee surveys via Internet or paper? The influence of administration mode, anonymity, voluntariness...; 2004; Reips, U.-D., Franek, L.
- Online Experiments in Commercial Market Research; 2004; Nordmeyer, C.-F., Geissler, H., Donath, T.
- Salutation, Power and behaviour in on-line panels; 2004; Joinson, A. N., Reips, U.-D.